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The  aggregation  principle  in  stochastic  optimization  was  exploited  to  build  an  algorithmic, 
progressive  hedging,  for  solving  such  problems.  Relationships  were  developed  between 
asymptotic  results  for  statistical  estimators  and  those  for  the  solution  of  stochastic  optimization 
!  problems. 
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DESCRIPTION  OF  THE  RESULTS 


In  summary.  I  havp  authorod  or  co-aiit horod  9  pap*T'.  wlulc  two  >iudt:’ii!s  have  ie  eii  wsakoin 
on  their  dissertations  (ofca.sionally  supported  as  R.A.’s  umler  this  »4rafil  i. 


Numerical  procedures  for  stochastic  programming  problems,  l  ln*  a.sriireyatioii  prini  jd'- 
ill  stochastic  optimixatioii  was  e.xploited  iti  "Scenarios  and  policy  as^sf’yation  in  ojoimi/a-tion  :in 
der  uncertainty"  ( .\fathf  mattes  of  0/h  rattons  H<  siairti.  lti(  19!)1 ),  1 19- !  17  )  to  build  an  alt>oi;i  iiniii 
procedure,  known  as  the  progres^ive  hedging  (1*1!)  algorithm,  for  solving  stochastic  optinn/.ition 
problems.  This  method  ha.s  ri'ceived  a  number  of  experifnental  implemt.uitations  and  is  -tartitig 
to  be  relatively  well  understood.  In  [6]  a  dual  strategy  for  the  implementation  of  the  aggregaf ioti 
principle  is  proposed.  Bradford's  dissertation  [12]  is  mostly  devoted  to  the  questions  raised  l,y 
the  implementation  of  the  PH  algorithm  on  machines  with  single  or  parallel  processors.  Tl,e 
analysis  is  both  theoretical  and  numerical.  In  particular,  he  is  able  to  obtain  very  sharp  bounds 
on  the  optimal  setting  of  the  key  parameters  of  the  algorithm.  N’umerical  experimentation  with 
small  to  medium  size  problems  confirms  that  a  good  choice  of  these  parameters  will  r<'.sult  in 
significant  speed  up  of  the  performance  of  the  algorithm. 

Dong  [13]  wrote  subroutines  that  would  facilitate  the  manipulation  and  machine  feeding  of 
the  data  associated  with  the  formulation  of  a  stochastic  optimization  problem. 

In  addition  to  solutions  tools,  it  is  useful  for  tiie  modeler  of  a  stochastic  optimization  problem 
to  have  at  its  disposal  a  number  of  numerical  routines  that  would  allow  him  to  check  if  his  problem 
is  well-formulated.  Elecause  stocha.stic  programming  problems  can  be  quite  complex,  modeling 
errors  a^-e  potentially  much  more  difficult  to  detect.  Preprocessing  tools  that  would  identify 
infeasibilities,  unboundedness,  and  the  contribution  of  randomness,  are  developed  for  stochastic 
linear  programs  in  [7].  and  further  specialized  to  the  case  of  problems  whose  recourse  proce.ss  can 
be  formulated  as  capacitated  network  problems  in  [S].  These  articles  also  report  about  the  use 
of  these  techniques  to  analyze  a  number  of  stochastic  programs  found  in  the  literature,  and  it  is 
demonstrated  that  quite  a  bit  of  insight  could  be  gained  from  their  use.  To  obtain  an  efficient  way 
of  describing  feasibility  in  capacitated  network  flow  problems  [8],  there  was  a  need  to  improve  on 
the  characterization  of  feasibility  provided  by  the  Gale- Hoffman  inequalities,  this  led  to  [9]  that 
proposes  a  very  efficient  (and  elegant)  procedure  for  eliminating  the  redundant  inequalities. 


Approximations  for  stochastic  problems.  Under  this  title.  I  shall  review  mainly  applications 
of  epi-convergence  in  a  .stochastic  setting,  in  particular  in  the  design  of  approximation  schemes 
for  stochastic  optimization  problems,  to  some  e.stimation  problems  in  mathematical  stati.stics. 
and  in  stochastic  homogenization. 

The  overall  strategy  for  solving  a  s*'^f'l..,stic  optimization  problem  is  to  replace  a  given 
problem  by  a  simpler  one,  often  obtained  by  appro.ximating  the  probability  measure  that  governs 
the  distribution  of  the  random  quantities.  The  approximating  probability  measure  is  usually 
obtained  by  some  precise  di.scretization  scheme  (usually  requiring  the  calculation  of  conditional 


expectations)  or  by  sampiing.  In  both  cases,  one  is  faced  with  tlie  iineslion  of  knownsg  ii  tio' 
resulting  problem  will  actually  furnish  ati  approximate  solution. 

When  proceeding  by  discretizatiu:',  one  is  confronted  with  the  follouiug  (ju<"vi!o!!:  ui'-'-n  a 
random  variable  f  with  values  in  H  and  probability  distribution  I’,  an  integrand  f  :  E  x  \  -  iU. 

and  a  sequence  of  integramis  and  probability  measures  {  i  .  P"'  ].  t'  G  IN  }  convi'rging  in  'nine 
sense  to  (/,  F).  what  can  be  said  about  the  convergence  of  the  functionals 

to  {Kf](x)-.= 

Our  interest  in  epi-convergenre  comes  from  the  need  to  claim  that  the  minimizers  of  tfip  fuii«  ■ 
tionals  E'' f  converge  to  those  of  Ef.  Articles  [ij  and  {'2]  deal  with  this  ipieslion.  In  the  first  one 
[l],  the  function  /  is  fixed  (doesn't  depend  on  i/)  with  dom  /(^.•)  constant,  'fhe  fact  tliat  weakiv 
convergent  measures  P“  —  P  converge  uniformiy  on  certain  classes  of  set,  is  used  to  obtain 
the  epi-  and  pointwise  convergence  of  the  integral  functionals  fP'/  to  Elf.  The  result  is  then 
applied  to  approximation  schemes  for  deterministic  and  stochastic  control  problems.  Althougii. 
this  theorem  improved  on  those  previously  known,  it  was  still  somewhat  less  than  totally  satis¬ 
factory.  On  one  hand,  we  were  getting  more  than  desired  (epi  and  pointwise  convergence i.  and 
on  the  other  hand,  the  assumption  of  constant  domain  was  certainly  less  than  wished  for.  The 
results  of  the  next  paper  [2]  no  longer  suffers  from  these  shortcomings,  and  in  addition  allows 
for  the  dependence  of  /  on  u.  A  new  notion  of  convergence  for  integrands  is  proposed.  There 
are  no  assumptions  about  the  continuity  of  /  with  respect  to  ^  and  this  opens  up  a  new  range 
of  potential  applications.  .Stochastic  optimization  problems  with  discontinuous  cost  functions  (a 
simple  inventory  example  i.s  analyzed  in  [2j).  control  of  discrete  events  systems  and  stochastic 
integer  programs  involve  integrands  that  are  only  exceptionally  continuous  in 

The  substitution  of  the  given  probability  measure  by  an  empirical  measure  generated  by 
a  sample  is  justified  by  the  law  of  large  numbers  for  random  Isc  functions  proved  in  [T].  It  is 
shown  that  \(  {  :  E  —  fcns(.Y).i-'  G  LV  }  is  a  sequence  of  epi-iid  random  Isc  functions,  then 

e-limt.(  l/i/)  Z*'  =  £/*  almost  surely  (fcns(  V )  is  the  space  of  Isc  functions  defined  on  .V  ).  Tiie 

result  is  proved  [I]  when  A'  is  finite  dimensional. 

The  relationship  between  stochastic  optimization  and  mathematical  statistics  is  pursued 
in  [4]  and  [-5].  In  [4].  it  is  shown  that  the  consistency  of  parametric  or  noiiparametric  estima¬ 
tors,  even  when  there  are  constraints  on  the  choice  of  the  estimator,  can  be  derived  from  the 
a. s. -convergence  of  the  solutions  of  stochastic  optimization  problems  described  above.  The  rela¬ 
tionship  between  the  asymptotic  results  for  statistical  estimators  and  those  for  the  solutions  of 
stochastic  optimization  problems  is  also  reviewed. 

A  standard  approach  to  deriving  the  consistency  of  estimators  relies  on  the  almost  sure 
uniform  convergence  of  the  empirical  measures  on  certain  cla.sse,s  of  subsets  of  A  (the  cr-field  of 
events).  By  introducing  a  certain  topology,  eventually  called  the  rouejh  topnUxjy.  on  the  subspace 
of  closed  sets  in  ^4,  a  criterion  is  given  in  [-5]  that  can  be  used  to  check  if  a. s. -uniform  convergence 
of  the  empirical  measures  will  actually  hold  for  any  given  class  of  sets.  One  of  the  implications 
of  [-5]  is  that  we  now  know  tha.t  a. s. -uniform  convergence  of  the  empirical  measures  hold.s  for  a 
much  richer  class  of  sets  than  those  identified  up  to  now. 


